System and method for personalized virtual reality experience in a controlled environment

ABSTRACT

A system and method for initiating a personalized virtual reality session via a virtual reality communication system in a controlled environment is disclosed. The system includes a profile subsystem configured to store an inmate profile of the inmate of the controlled environment. The system also includes a virtual reality subsystem that retrieves the inmate profile associated with the inmate from the profile subsystem, initiates the virtual reality session involving a first communication device used by the inmate of the controlled environment, and personalizes the virtual reality session based on the inmate profile. The system also includes a communication subsystem configured to transmit information related to the virtual reality session to a monitoring system.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. Nonprovisional patentapplication Ser. No. 16/558,931 (Attorney Docket No. 3210.1300001),filed Sep. 3, 2019, which is a continuation of U.S. Pat. No. 10,404,804(Attorney Docket No. 3210.1300000), filed Jan. 30, 2017, and all ofwhich are entitled “System and Method for Personalized Virtual RealityExperience in a Controlled Environment,” the contents of all are herebyincorporated herein by reference in their entirety

BACKGROUND Field

This disclosure relates to a system and method for providing a monitoredvirtual reality experience within a controlled environment.

Background

In a controlled environment such as a correctional facility, inmateshave limited opportunities to interact with the outside world. Inmatesmay have opportunities to have certain communications with loved ones,browse websites using a mobile device, or interact with certain content,but these opportunities are limited to the inmate's room or cell anddesignated rooms within the controlled environment. In other words, aninmate's experiences are limited to one or two physical communicationswhen conducting conventional communications in a controlled environment.

BRIEF DESCRIPTION OF THE DRAWINGS/FIGURES

The accompanying drawings, which are incorporated herein and form a partof the specification, illustrate embodiments of the present disclosureand, together with the description, further serve to explain theprinciples of the disclosure and to enable a person skilled in thepertinent art to make and use the embodiments.

FIG. 1 illustrates a block diagram of a virtual reality communicationsystem, according to embodiments of the present disclosure.

FIG. 2 illustrates a block diagram of a communication center of thevirtual reality communication system of FIG. 1, according to embodimentsof the present disclosure.

FIG. 3 illustrates a block diagram of a virtual reality communicationdevice of the virtual reality communication of FIG. 1, according toembodiments of the present disclosure.

FIG. 4A illustrates a block diagram of a virtual reality communicationsystem, according to embodiments of the present disclosure.

FIG. 4B illustrates a block diagram of a virtual reality communicationsystem, according to embodiments of the present disclosure.

FIG. 4C illustrates a block diagram of a virtual reality communicationsystem, according to embodiments of the present disclosure.

FIG. 5 illustrates a flowchart diagram of a method of registering a uservia the communication system of FIG. 1, according to embodiments of thepresent disclosure.

FIG. 6 illustrates a flowchart diagram of a method of initiating avirtual reality session via the communication system of FIG. 1,according to embodiments of the present disclosure.

FIG. 7 illustrates a flowchart diagram of a method of monitoring avirtual reality session via the communication system of FIG. 1,according to embodiments of the present disclosure.

FIG. 8 illustrates a block diagram of a general purpose computer thatmay be used to perform various aspects of the present disclosure.

The present disclosure will be described with reference to theaccompanying drawings. In the drawings, like reference numbers indicateidentical or functionally similar elements. Additionally, the left mostdigit(s) of a reference number identifies the drawing in which thereference number first appears.

DETAILED DESCRIPTION

The following Detailed Description refers to accompanying drawings toillustrate exemplary embodiments consistent with the disclosure.References in the Detailed Description to “one exemplary embodiment,”“an exemplary embodiment,” “an example exemplary embodiment,” etc.,indicate that the exemplary embodiment described may include aparticular feature, structure, or characteristic, but every exemplaryembodiment may not necessarily include the particular feature,structure, or characteristic. Moreover, such phrases are not necessarilyreferring to the same exemplary embodiment. Further, when a particularfeature, structure, or characteristic is described in connection with anexemplary embodiment, it is within the knowledge of those skilled in therelevant art(s) to affect such feature, structure, or characteristic inconnection with other exemplary embodiments whether or not explicitlydescribed.

The exemplary embodiments described herein are provided for illustrativepurposes, and are not limiting. Other exemplary embodiments arepossible, and modifications may be made to the exemplary embodimentswithin the spirit and scope of the disclosure. Therefore, the DetailedDescription is not meant to limit the disclosure. Rather, the scope ofthe disclosure is defined only in accordance with the following claimsand their equivalents.

Embodiments may be implemented in hardware (e.g., circuits), firmware,software, or any combination thereof. Embodiments may also beimplemented as instructions stored on a machine-readable medium, whichmay be read and executed by one or more processors. A machine-readablemedium may include any mechanism for storing or transmitting informationin a form readable by a machine (e.g., a computing device). For example,a machine-readable medium may include read only memory (ROM); randomaccess memory (RAM); magnetic disk storage media; optical storage media;flash memory devices; electrical, optical, acoustical or other forms ofpropagated signals (e.g., carrier waves, infrared signals, digitalsignals, etc.), and others. Further, firmware, software, routines,instructions may be described herein as performing certain actions.However, it should be appreciated that such descriptions are merely forconvenience and that such actions in fact result from computing devices,processors, controllers, or other devices executing the firmware,software, routines, instructions, etc. Further, any of theimplementation variations may be carried out by a general purposecomputer, as described below.

For purposes of this discussion, any reference to the term “module”shall be understood to include at least one of software, firmware, andhardware (such as one or more circuit, microchip, or device, or anycombination thereof), and any combination thereof. In addition, it willbe understood that each module may include one, or more than one,component within an actual device, and each component that forms a partof the described module may function either cooperatively orindependently of any other component forming a part of the module.Conversely, multiple modules described herein may represent a singlecomponent within an actual device. Further, components within a modulemay be in a single device or distributed among multiple devices in awired or wireless manner.

The following Detailed Description of the exemplary embodiments will sofully reveal the general nature of the disclosure that others can, byapplying knowledge of those skilled in relevant art(s), readily modifyand/or adapt for various applications such exemplary embodiments,without undue experimentation, without departing from the spirit andscope of the disclosure. Therefore, such adaptations and modificationsare intended to be within the meaning and plurality of equivalents ofthe exemplary embodiments based upon the teaching and guidance presentedherein. It is to be understood that the phraseology or terminologyherein is for the purpose of description and not of limitation, suchthat the terminology or phraseology of the present specification is tobe interpreted by those skilled in relevant art(s) in light of theteachings herein.

Virtual Reality Communication System

FIG. 1 illustrates a block diagram of virtual reality communicationsystem 100, according to embodiments of the present disclosure. Virtualreality communication system 100 includes communication center 110configured to receive and transmit virtual reality information within avirtual reality session to inmate communication system 120. A virtualreality session allows an inmate of a controlled environment to interactwith content in virtual environment and, for a brief time, imaginehimself outside or away from the controlled environment.

In some embodiments, the virtual reality session can also includeoutsider communication system 130 if an outsider is authorized andregistered and otherwise allowed to communicate with the inmateassociated with inmate communication system 120. In this disclosure, asession refers to a virtual reality communication, which may includereal-time communications such as voice calls and video calls, andnon-real time communications such as a text or email, between an inmateusing inmate communication system 120, communication center 110, and anoutsider using outsider communication system 130.

In an embodiment, inmate communication system 120 includes one or moredevices provided to inmates within a correctional facility and includesany or all devices such as wireless communication device 122, virtualreality communication devices 123, 124, and 136, and/or computer station126. In an embodiment, virtual reality communication device 135 isconnected to computer station 126 and virtual reality communicationdevice 136 is connected to wireless communication device 122. Virtualreality communication devices 123, 124, and 136 have wired and/orwireless communication capabilities. In an embodiment, virtual realitycommunication device 124 may communicate directly with network 101through a wireless connection, such as Bluetooth™ or Wi-Fi connections.In another embodiment, virtual reality communication device 124 maycommunicate directly with network 101 through a wired connection such asa USB cable.

Similarly, virtual reality communication device 123 communicates withnetwork 101 through a connection with wireless communication devices122. The communication with wireless communication devices 122 may be awireless connection, such as Bluetooth™ or Wi-Fi connections or througha wired connection such as with a USB cable.

In an embodiment, virtual reality communication device 136 communicateswith network 101 through a connection with computer station 126. Thecommunication with computer station 126 may be a wireless connection,such as Bluetooth™ or Wi-Fi connections or through a wired connectionsuch as with a USB cable.

In an embodiment, communication center 110 connects to wireless accesspoint 125 (e.g., a router), which may provide connectivity to virtualreality communication device 124. Inmate communication system 120connects to communication center 110 via network 101, which may includeany or all of a Local-Area Network (LAN), a Wide-Area Network (WAN), orthe Internet.

Outsider communication system 130 includes one or more devices availableto outsiders to the controlled environment and includes any and alldevices such as virtual reality communication device 132, virtualreality communication device 134, computer station 136, and/or wirelesscommunication device 138. In an embodiment, outside communication system130 may be located within the controlled environment, such as in adesignated area or room of the controlled environment. In anotherembodiment, outside communication system 130 may be located outside ofthe controlled environment such as in the outsider's home. Outsidercommunication system 130 connects to communication center 110 vianetwork 103, which may include any or all of a WAN, the Internet, and/ora Public Switched Telephone Network (PSTN). The WAN may facilitatecommunications with other nearby prisons, such as those within the samecounty, state, etc.

In an embodiment, WebRTC may be utilized in place of a sessioninitiation protocol (SIP) over a WAN or the Internet, each of whichprovides a dedicated, private link between inmate communication system120 and outsider communication system 130. The Internet is utilized toprovide access to computer station 136 such as remotely distributedcontrol stations, scheduling clients, and home visitation devices.

In an embodiment, virtual reality communication system 100 also includesmonitoring center 140 for monitoring communications within virtualreality communication system 100 and between inmate communication system120 and outsider communication system 130. Monitoring by monitoringcenter 140 occurs both automatically and manually by a reviewer.Monitoring center 140 is configured to receive communications fromcommunication center 110 via network 105, which may include any or allof a LAN, a WAN, or the Internet. In an embodiment, monitoring center140 is further configured to communicate with communication center 110to indicate approval of starting, sending, or receiving a virtualreality session after an initial authentication of the virtual realitysession has been performed. Monitoring center 140 receives informationrelated to all virtual reality sessions that take place between devicesin virtual reality communication system 100 through communication center110. Monitoring center 140 can then utilize this information byrecording the virtual reality session for later review and/or monitorthe actions of users within the virtual reality communication system100. In an embodiment, recording of the virtual reality session entailsrecording one or more aspects of the virtual reality session. Aspects ofthe virtual reality session include an audio stream of the virtualreality session, a video stream of the virtual reality session, andactions performed by the users during the virtual reality session. Ifusers perform prohibited actions or interactions, monitoring center 140may terminate the virtual reality session or provide a warning to theusers. Monitoring center 140 may provide a predetermined number ofwarnings to the users prior to terminating the virtual reality session.In another embodiment, monitoring center 140 is integrated intocommunication center 110.

In an embodiment, monitoring center 140 provides to communication center110 authorized content that is available for use as part of any virtualreality sessions. For example, authorized content includes a list ofwebsites that are available to be accessed by a user within a virtualreality session, a list of websites that are not available to beaccessed, a list of games, and a list of applications such as a wordprocessing application, a text messaging application, a video callingapplication, and a multimedia application.

In an embodiment, content is authorized on a per user basis (i.e.,applies only to a specific user or users based on, for example, theprofile information) or on a global basis (i.e., applies to all virtualreality sessions through communication center 110). In Monitoring center140 can modify user profiles to include information that indicates thecontent for which the users are authorized and not authorized. Forglobal restrictions, monitoring center 140 can send information thatindicates the content that is authorized and not authorized for allusers and all virtual reality sessions.

Communication Center

FIG. 2 illustrates a block diagram of communication center 200,according to embodiments of the present disclosure. In an embodiment,communication center 200 represents an exemplary embodiment ofcommunication center 110 of FIG. 1. Communication center 200 includes atleast processing subsystem 210 and communication database 220, as shownby FIG. 2. Processing subsystem 210 includes one or more processors,computers, or servers identified as subsystems and can be constructed asindividual physical hardware devices, or as virtual devices, such as avirtual server. The number of processing subsystems can be scaled tomatch the number of simultaneous user connections desired to besupported by virtual reality communication system 100. Processingsubsystem 210 includes communication subsystem 212, profile subsystem,214, and authentication subsystem 216.

In an embodiment, communication subsystem 212 controls the routing ofcommunications to an end destination such as one or more devices withininmate communication system 120, one or more devices within outsidercommunication system 130, or monitoring center 140. Communicationsubsystem 212 performs switching required to electrically connect theone or more devices within inmate communication system 120 and one ormore devices within outsider communication system 130 for a virtualreality session. Further, communication subsystem 212 logs communicationinformation, including time of communications and parties involved inthe communications, and store the logs and communications as files. Thefiles stored by communication subsystem 212 can be stored indefinitelyfor use by monitoring center 140 in monitoring and investigation of aninmate and/or communication. Communication subsystem 212 also determineswhether a communication should be monitored such that privilegedcommunications such as attorney/client, doctor/client, or investigativecommunications are not monitored. Criteria for monitoring acommunication may be based on jurisdictional requirements and/oridentities of the parties.

In an embodiment, communication subsystem 212 is configured to receivecontact information such as a phone number, email address, internetprotocol address or other identifying data of the parties involved inthe communication. The received contact information may be used by eachof the subsystems of the communication center 200 for identifyingrespective data and processes related to the contact information, suchas purported identities of parties involved in the communication.

Because there may be a variety of different communication standardsemployed by different audio, video, image, and text devices that wish toparticipate in communications, in an embodiment, communication subsystem212 is also configured to perform format conversion of non-real timecommunications. Conversion of incoming and outgoing communications areperformed, as needed, to be compatible with inmate communication device120, outsider communication device 130, or monitoring center 140.

Further, because communication subsystem 212 receives and transmitscommunications by way of a network, in an exemplary embodiment,communication subsystem 212 is configured to decrypt receivedcommunications and encrypt transmitting communications, for securitypurposes.

Profile subsystem 214 obtains and stores profile information on partiesregistered to communicate via virtual reality communication system 100.In an embodiment, profile subsystem 214 stores inmate profiles andoutsider profiles. Profile subsystem 214 obtains information related tothe parties from one or more of (a) a jail management system (JMS) or anoffender management system (OMS) operated by the jurisdiction of thecorrectional facility, (b) public database containing information on theparties, or (c) a questionnaire provided by a web page, a personalapproved number (PAN) list, or booking information. Information obtainedby profile subsystem 214 may include personal information such asprevious residences or correctional facilities, authorized contacts,family members, languages, special needs, medication requirements, etc.

Profile subsystem 214 also performs a registration process for thoseparties not enrolled or registered to use virtual reality communicationsystem 100. During the registration process, or at a later time, profilesubsystem 214 determines accommodations and settings associated with aparty and/or a party is able to select preferred settings for acommunication. These accommodations and settings include, but are notlimited to, preferences of the virtual reality session, such as virtuallocales (e.g., beach, forest) and avatar information such as theappearance of the party's virtual representation within the virtualreality session.

In an embodiment, profile subsystem 214 also receives authorizationinformation indicating content that is authorized and not authorized foreach profile. The information may be received from a monitoring systemsuch as monitoring center 140 as illustrated in FIG. 1. Profilesubsystem 214 can store the authorization information internally or incommunication database 222. If the information is specific to a user oruser(s), profile system 214 can also store the information as part ofthe user or user(s) profile(s). The authorization information is used topersonalize the virtual reality session by limiting or allowing accessto the content by users of the virtual reality session.

Authentication subsystem 216 collects and stores identity data ofinmates and outsiders authorized to access virtual reality communicationsystem 100. Identity data includes at least one of a username andpassword data, challenge questions, challenge answers, biometric data,device data such as make and model of a communication device, and/orlocation data. Biometric data includes one or more of a finger print, ahand print, a voice sample, an iris or retinal sample, an image of theuser (2D or 3D), a hand geometry, a signature identification, aninfrared camera identification, or any other biometric as deemedappropriate. The challenge question form of identity data may be aseries of challenge questions, or a single challenge question such asthe last four digits of an inmate's social security number, mother'smaiden name, and the like. Authentication subsystem 216 is furtherconfigured to facilitate a secure communication between partiesreceiving/transmitting a communication by performing identityverifications to authenticate identities of purported parties. Theidentity verification includes logon verifications, such as username andpassword verifications, biometric verification, response to challengequestions, device verification, and/or location verification.

In embodiment, authentication subsystem 216 continuously tracksbiometric information during an on-going virtual reality session. Forexample, authentication subsystem 216 continuously tracks a user's eyesand provides the iris or retinal sample to a monitoring center throughcommunication subsystem 212. In this manner, the monitoring center maymonitor the virtual reality session to insure that an authenticated userdoes not hand off the virtual reality communication device to anotheruser who has not been authenticated by authentication subsystem 216.Authentication subsystem 216 may also continuously monitor the voicesduring the virtual reality session and provide this voice information tothe monitoring subsystem through communication subsystem 212.

Authentication subsystem 216 performs an identity verification byreceiving identity information such as one or more of a username andpassword, a response to a challenge question(s), a keypad or touch padentry, dual tone multi frequency (DTMF) response, a voice sample, afingerprint sample, a retinal sample, a facial image (2D or 3D), deviceinformation such as a make and model of the communication device, and/ora location of the communication device, from a communication device(such as a device of inmate communication system 120 or outsidercommunication system 130) used by a purported party and comparing theidentity information of the purported party with stored identity data.Authentication subsystem 216 also uses the collected information toregister users of virtual reality communication system 100. Onceregistered and entered into the system, users may log into virtualreality communication system 100 and initiate a virtual reality session.

Web subsystem 218 runs web server software such as Apache and/orMicrosoft Internet Information Server and/or an interactive voiceresponse (IVR) server software. The primary function of web subsystem218 is to operate as a frontend and/or backend server in receiving andtransmitting information to a party outside of communication center 200.In an embodiment, web subsystem 218 serves as a maintenance point intocommunication center 200, by which servicing, configuring, and updatingcan be performed. In an embodiment, the web subsystem 218 providesmanaging services for generating communications, receiving instructionsfrom a party to send or receive communications, and coordinating andscheduling the transmission of communications. For example, websubsystem 218 can facilitate a party in generating a non-real timecommunication when the party uses a front-end application having a userinterface.

In an embodiment, virtual reality subsystem 220 consists of any numberof servers, and functions as the primary logic processing center incommunication center 200. Virtual reality subsystem 220 manages andfacilitates overall communication between subsystems off thecommunication center 200 and devices external to the communicationcenter, such as any device within inmate communication system 120 andoutsider communication system 130. After undergoing registration andauthentication procedures as described above, virtual reality subsystem220 initiates the virtual reality sessions for one or more virtualreality communication devices within virtual reality communicationsystem. No matter the number of virtual communication devices, virtualreality subsystem 220 routes information regarding all virtual realitysessions to a monitoring center, such as monitoring center 140 in FIG.1, through communication subsystem 212. Using this information, themonitoring center may monitor all aspects of virtual reality sessions,including the avatars, the actions taken by the avatars, the virtualreality environment such as the virtual details, and the interactionsbetween the avatars and the virtual reality environment.

In an embodiment, virtual reality subsystem 220 initiates virtualreality sessions based on the stored profiles of the user(s) involved inthe virtual reality session. An example profile is an inmate profilethat includes the preferences of an inmate of a controlled environmentand/or an outsider profile that includes the preferences of an outsiderof the controlled environment. If a virtual reality session involves auser with a virtual reality communication device, virtual realitysubsystem 220 retrieves the user profile for the user and personalizesthe virtual reality session based on the preferences and informationstored in the user profile. Personalizing the virtual reality sessionincludes using a stored avatar with the stored appearance settings,setting the environment of the virtual reality session, and makingavailable within the virtual reality session preferred content andapplications such as games. If the virtual reality session involves twoor more users, virtual reality subsystem 220 retrieves the user profilesfor each of the users and personalizes the virtual reality session basedon the preferences and information stored in the user profiles. If thereare any conflicts in preferences, virtual reality subsystem 220 canprioritize certain user profiles and implement the preferences of userprofiles that are prioritized higher than others.

In an embodiment, personalizing the virtual reality session alsoincludes incorporating administrator preferences provided by anadministrator of virtual reality system 100, such as a designatedemployee of the controlled environment. Administrator preferences arerules or restrictions provided by the administrator and have higherpriority than the preferences specified in the user profiles. In anembodiment, administrator preferences include global preferences thatinfluence all virtual reality sessions, no matter the users involved inthe virtual reality session and inmate-specific preferences that onlyapply to specific inmates.

Administrator preferences generally limit or allow actions that can beperformed by users during a virtual reality session. For example, theadministrator can restrict all inmates and outsiders from accessingwebsites deemed to be inappropriate or certain applications and/orspecify specific websites or applications that may be accessed during avirtual reality session. As discussed above, an administrator canimplement such restrictions on a global (all virtual reality sessions)or inmate-specific basis.

In an embodiment, virtual reality subsystem 220 controls content that isavailable to users within virtual reality sessions based onauthorization information indicating authorized content and unauthorizedcontent. The authorization information can be specific to a user oruser(s) and/or applied globally to all virtual reality sessions.Authorization information can indicate that a user or user(s) are notallowed to access certain content, such as websites, games, and/orapplications, while participating in the virtual reality session. Forexample, if a user's profile indicates that the user is not allowed toaccess a certain website, the user would not prevented from using avirtual reality browser within a virtual reality session, such asvirtual reality browser window 406 of FIG. 4B, to access the certainwebsite.

Communication database 222 consists of any number of databases and/orservers, and stores and organizes data in a relational database.Communication database 222 runs a database management system, such asMYSQL™, to provide an example. Communication database 222 includesorganized data such that respective identity data, authentication data,jurisdictional requirements and rules, and settings that are indexed andlinked to allow access to data for each of the parties involved in acommunication and data associated with each of the parties.

Virtual Reality Communication Device

FIG. 3 illustrates a block diagram of virtual reality communicationdevice 300, according to embodiments of the present disclosure. Virtualreality communication device 300 may be an exemplary embodiment of anyof virtual reality communication devices 123, 124, 132, 134, or 135 asillustrated in FIG. 1. In an embodiment, virtual reality communicationdevice 300 includes processor circuitry 310 that is communicativelycoupled to plurality of communication interfaces 320, input/outputcircuitry 330, positional and motion circuitry 340, and virtual realitydisplay 350. Processor circuitry 310 includes one or more processors312, circuitry, and/or logic configured to control the overall operationof communication device 300, including the operation of communicationinterfaces 320, input/output circuitry 330, and positional and motioncircuitry 340. Processor circuitry 310 further includes memory 314 tostore data and instructions. Memory 314 may be any well-known volatileand/or non-volatile memory that is removable and/or non-removable.

Communication interfaces 320 include one or more transceivers,transmitters, and/or receivers that communicate via a wirelessinterface, such as through one or more antennas 322, or a wiredinterface, such as through a USB cable. In an embodiment, communicationinterfaces 320 are configured to transmit and receive communicationsbetween an inmate and an outsider via network 101 and network 103, asillustrated in FIG. 1. In an embodiment, communication interfaces 320connect virtual reality communication device 300 with other devices suchas a mobile device and/or external input devices such as a keyboard,mouse, camera, or touch interface.

In an embodiment, virtual reality communication device 300 includesintegrated input/output circuitry 330 includes circuitry such as akeypad, a touch interface, a microphone, and a camera. Input/outputcircuitry 330 may be used by a party for traditional mobile devicecommunications such as audio, video, or text communications.Input/output circuitry 330 such as the microphone and camera are usedduring monitoring operations to capture audio and/or video of a partyand surrounding areas.

In an embodiment, virtual reality communication device 300 may includepositional and motion sensors 340 include circuitry for determining acurrent location and a change in location of communication device 300.Positional and motion circuitry 340 may include such circuitry as GlobalPositioning System (GPS) technology, indoor positioning systems (IPS)technology, accelerometers, and/or gyroscopes to determine position andmotion of virtual reality communication device 300.

Input/output circuitry 330 and positional and motion sensors 340 canprovide input to virtual reality communication device 300 through head,body, arm, eye and finger, movements. Eye movement of a user of avirtual reality communication device 300 can be monitored. Eye movementof the user can operate much like a mouse by following the eye movementmoving a cursor and utilizing the blinks of the eyes to select an item(i.e., similar to a mouse click). This allows for the entry of alphanumeric or the selection of items from the display without the userhaving to use his fingers or hands. Lunges and direction changes can becaptured with accelerometers and gyroscope devices of positional andmotion sensors 340.

Virtual reality display 350 is component for displaying virtual realityimages or scenes for viewing by a user of the virtual realitycommunication device 300. In an embodiment, virtual reality display 350is a display of a standalone virtual reality device that may be worn bya user. Virtual reality display 350 provides a high-resolution and wideangle view (e.g., 115 degrees) of a virtual reality session. In anotherembodiment, virtual reality display 350 may be implemented as a displayof a mobile device such as a mobile phone, smartphone, or tablet. Themobile device may then be attached to a headpiece that may be worn bythe user.

System Operation

Exemplary usage of virtual reality communication system 100 in acorrectional environment will be described with respect to FIGS. 4A-4C.In an embodiment, FIG. 4A depicts an exemplary embodiment of a virtualreality session 400A between inmate communication device 401A, outsidercommunication device 401B, and monitoring center 402. Virtual realitysession 400A includes virtual reality communication 403 depicts anexemplary visual environment that is simultaneously viewable by inmatecommunication device 401A, outsider communication device 401B, andmonitoring center 402. Virtual reality communication 403 issimultaneously viewable through a display of inmate communication device401A and a display of outsider communication device 401B. Virtualreality communication 403 also provides an audio channel through whichusers of inmate communication device 401A and outsider communicationdevice 401B talk with each other using for example a microphone ofinmate communication device 401A and outsider communication device 401Bor that is part of an external device connected to inmate communicationdevice 401A and outsider communication device 401B. In an embodiment,virtual reality communication 403 includes an inmate avatar 404 and anoutsider avatar 405. Inmate avatar 404 is a personalized virtualrepresentation of a user of inmate communication device 401A andoutsider avatar 405 is a personalized virtual representation of a userof outsider communication device 401B. As further discussed with respectto FIG. 5, a user, such as an inmate of a controlled environment or anoutsider of the controlled environment, can customize his avatar as partof a registration process. Accordingly, users of inmate communicationdevice 401A and outsider communication device 401B may talk with andview a virtual representation of each other as part of virtual realitycommunication 403.

In an embodiment, virtual reality communication 403 is also viewable bymonitoring center 402. As will be further discussed with respect to FIG.7, monitoring center 402 monitors virtual reality communication 403including the actions of users of inmate communication device 401A andoutsider communication device 401B. Monitoring center 402 monitorsvirtual reality communication 403 to prevent prohibited actions fromoccurring within virtual reality communication 403.

In an embodiment, inmate communication device 401A, outsidercommunication device 401B, and monitoring center 402 are implementedwithin a virtual reality communication system such as virtual realitycommunication system 100. One of ordinary skill in the art wouldunderstand that virtual reality session 403 is merely exemplary. Forexample, virtual reality session is not limited to only two users withinvirtual reality session 400A, which may include one user or more thantwo users participating in virtual reality communication 403.

FIG. 4B depicts an exemplary embodiment of a virtual reality session400B between inmate communication device 401A, outsider communicationdevice 401B, and monitoring center 402. Virtual reality session 400Bincludes virtual reality communication 403 which depicts an exemplaryimage that is viewable by communication device 401A, outsidercommunication device 401B, and monitoring center 402. Virtual realitycommunication 403 includes virtual browser window 406 that issimultaneously viewable through a display of inmate communication device401A, a display of outsider communication device 401B, and a display atmonitoring center 402. Virtual browser window 406 is also controllableby users of inmate communication device 401A and outsider communicationdevice 401B. Virtual browser window 406 can display information orcontent simultaneously to users of inmate communication device 401A andoutsider communication device 401B. The information or content is alsocontrollable by the users such that any user participating in virtualcommunication 403 to manipulate or interact with virtual browser window406. In an embodiment, content includes game play activity such as agame that is played by a user of inmate communication device 401A and/ora user of outsider communication device 401B. Other content can alsoinclude displaying multimedia such as movies or television shows,documents such as emails, or websites. Users may control and interactwith content displayed on virtual reality communication window 406 usinginput/output circuitry of inmate communication device 401A and/or a userof outsider communication device 401B or external input/output devicesas discussed with respect to FIG. 3.

In an embodiment, virtual reality communication 403 provides an audiochannel through users of inmate communication device 401A and outsidercommunication device 401B may talk with each other while interactingwith the virtual browser window 406. Virtual reality communication alsoincludes an inmate avatar 404 and an outsider avatar 405. Accordingly,users of inmate communication device 401A and outsider communicationdevice 401B may talk with, view a virtual representation of each other,and interact with virtual elements of virtual reality communication 403.

FIG. 4C depicts an exemplary embodiment of a virtual reality session400A between inmate communication device 401A, outsider communicationdevice 401B, and monitoring center 402. Virtual reality session 400Cincludes virtual reality communication 403 which depicts an exemplaryimage that is viewable by communication device 401A, outsidercommunication device 401B, and monitoring center 402. In an embodiment,virtual reality communication 403 includes a virtual reality environmenthaving virtual elements such as a virtual sun 308 and virtual tree 307that is simultaneously viewable through a display of inmatecommunication device 401A, a display of outsider communication device401B, and a display at monitoring center 402. In an embodiment, users ofinmate communication device 401A and outsider communication device 401Bmay select the virtual reality environment from a set of optionspre-approved by the controlled environment. Examples of otherenvironments include a beach, a forest, a house, or a store. In anembodiment, the virtual store environment is modeled on the controlledenvironment's commissary and the virtual elements include items that maybe purchased by the user.

Operations of providing access, initiating communications, andmonitoring communications within virtual reality communication system100 in a correctional system will be described with respect to FIGS.5-7. Although the physical devices and components that form the systemhave largely already been described, additional details regarding theirmore nuanced operation will be described below with respect to FIGS.1-3. While FIGS. 5-7 contain methods of operation of authentication forvirtual reality communication system 100, the operations are not limitedto the order described below, and various operations can be performed ina different order. Further, two or more operations of each method can beperformed simultaneously with each other.

FIG. 5 illustrates a flowchart diagram of a method 500 of registering auser via a virtual reality communication system, such as virtual realitycommunication system 100 of FIG. 1, according to embodiments of thepresent disclosure. In FIG. 5, a registration or enrollment process isfacilitated for a party by inmate communication device 120 or outsidercommunication device 130. In 501, a user registers before or during thefirst use of virtual reality communication system 100. Registration maybe performed via a website or IVR system, for example, when a partyvisits a designated website or calls a designated phone numberfacilitated by the controlled environment. In 501, profile subsystem 214(as described with respect to FIG. 2) requests for initial informationfrom the user via inmate communication device 120 or outsidercommunication device 130. The initial information can include name,birthdate, social security number, contact information, a biometricsample, and/or other essential data needed to verify the user and obtainadditional information associated with the user, as described below. Theinitial information can also include preferences from the user regardingthe user's avatar. These preferences allow the user to customize theappearance of the avatar such as the avatar's hair, facial features,clothing, and other physical attributes. Such preferences can allow theuser to create an avatar with a similar virtual appearance as the user.The initial information may be received by input/output circuitry 330 ofvirtual reality communication device 300 and transmitted tocommunication center 110 via communication interface 320.

Once the initial information is received by communication center 110,profile subsystem 214 generates a user profile, such as an inmateprofile, based on the initial information provided by the user at 502.Next, profile subsystem 214 generates an avatar based on the initialinformation provided by the user at 503. At 504, a component of thecontrolled environment, such as communication center 200, reviews thegenerated profile and avatar as part of a review process to ensure thatthe profile and avatar meet predefined standards. After review of theinitial information, the generated profile, and the generated avatar,communication center 200 may accept the registration, at 504, or rejectthe registration. In an embodiment, during steps 501-503, all gatheredand generated information obtained by communication center 110 is storedat 505 in a component of the controlled environment, such as in database220 of communication center 200.

FIG. 6 illustrates a flowchart diagram of a method 600 for initiating avirtual reality session via a virtual reality communication system, suchas virtual reality communication system 100 of FIG. 1, according toembodiments of the present disclosure. At 601, a method of initiating avirtual reality session begins with a user request. The user request canbe from an inmate of the controlled environment or may be from anoutsider of the controlled environment. The user request is transmittedby the inmate's virtual reality communication device or the outsider'svirtual communication device via virtual reality communication system100. In an embodiment, submitting a user request requires specialsoftware provided by the controlled environment and installed on thevirtual communication devices. For example, an inmate opens the specialsoftware and presses an icon to submit a request for a virtual realitysession, which can be limited to only the inmate or can also include anoutsider using outsider communication device 130.

Next, at 602, communication center 110 determines whether the usersubmitting the request is authorized to initiate a virtual realitysession. Communication center 110 can make this determination based oninformation included in the user request such as the identity of theuser, the virtual reality communication device from which the request issubmitted, or any other information identifying the user and/or thevirtual reality communication device. In an embodiment, authorizing theuser includes authenticating the user's identity. Examples ofauthentication that may be performed include one or more of challengequestions and biometric verifications. For example, a party may berequired to answer a challenge question including responding toquestions regarding one or more of a previous addresses of the party,the name of the party, a birthdate of the party, a PIN, a name ofsomeone associated with the party, or an identification number of theparty. Further, a challenge question may request only a portion of theactual answer, such as only the last four digits of the party's socialsecurity number be a response. Combination of authentication processesmay also occur and may include a rolling challenge question thatrequires the party to audibly or visually respond to the challengequestion. Examples of combinations of authentication may include aresponse to a challenge question that requires a party to audibly statehis/her mother's maiden name or for the party to respond to the answereither verbally or by touch paid while in front of a camera of inmatecommunication device 120 or outsider device 130 such that an audiosample, a video sample, or an image sample of the party is captured. Inembodiment, authentication subsystem 216 receives required informationfrom inmate communication device 120 or outsider communication device130 and the received information is compared to stored identity data todetermine whether the user is in fact authorized. If the user is notauthorized, the method ends. If the user is authorized, communicationcenter 110 can further determine whether the user is registered to usevirtual reality communication system 100 at 603. In an embodiment,communication center 110 can retrieve the relevant information to makethis determination from profile subsystem 214. If the user is notregistered, a registration or enrollment process is performed at 604. Anexemplary registration process may include steps described above forFIG. 5.

Upon determining that the user is authorized an registered,communication center 110 can then determine if any other users arejoining the virtual reality session at 605. Method 600 repeats steps602-604 for any additional users joining the virtual reality session.Once all users joining the session have been authorized and registered,communication center 110 personalizes the virtual reality session basedon the user(s) and their profiles at 606. In an embodiment,personalizing the virtual reality session includes retrieving theprofile(s) for each user and determining the preferences and otherinformation related to the virtual reality session. Each profile caninclude information regarding the user's avatar, preferences for contentsuch as games, applications, or virtual environments, and restrictionsas to the content that is available or not available to the user and/orthe virtual reality session. At 607, the virtual reality session isfurther personalized based on any administrator preferences. In anembodiment, this step entails retrieving the administrator preferencesand implementing the rules and restrictions on the virtual realitysession. As discussed above, administrator preferences may be applied ona global or in-mate specific basis. For example, administratorpreferences may include global restrictions which limit all virtualreality sessions from accessing inappropriate websites using the virtualreality browser window. Based on this information from the user profilesand the administrator preferences, communication center 110 generatesand initiates the virtual reality session at 608, and beginscommunicating the virtual reality session to the respective virtualreality communication devices of each user who is part of the virtualreality session.

FIG. 7 illustrates a flowchart diagram of a method 700 for monitoring avirtual reality session via a monitoring system, such as monitoringcenter 140 of FIG. 1, according to embodiments of the presentdisclosure. At 701, monitoring center 140 begins monitoring a virtualreality session initiated through a virtual reality communicationsystem, such as virtual reality communication system 100 of FIG. 1. At702, monitoring center 140 continuously monitors visual information ofthe virtual reality session for any prohibited actions performed by anyuser within the virtual session. Prohibited actions can include anyactions performed by a user's avatar that are determined by monitoringcenter 140 to be inappropriate for a virtual reality session. Forexample, prohibited actions include violent actions and lewd actions.

At 703, monitoring center 140 continuously monitors audio information ofthe virtual reality session for any prohibited verbal statements utteredby any user within the virtual session such as a session that involvesmore than one user. Prohibited verbal statements can include anycomments stated by a user during the virtual session determined bymonitoring center 140 to be inappropriate for a virtual reality session.For example, prohibited verbal statements can include curse words, lewdphrases, and/or sexual comments.

At 704, monitoring center 140 continuously monitors biometricinformation obtained from any user within the virtual session to preventauthorized users from giving the virtual reality communication device toa user that has not yet been authorized for the virtual reality session.As discussed above, in an embodiment, monitoring center 140 receivesbiometric information from communication center 110 which retrieves thebiometric information from the virtual reality communication devicesthat are participating in the virtual reality session. Biometricinformation includes audio information, retinal or iris information, andfacial information. During a virtual reality session, monitoring center140 can compare current biometric information with original biometricinformation from the authorized user who initiated or joined the virtualreality session. If monitoring center 140 determines that there isdifference between current biometric information and the originalbiometric information, monitoring center can determine that there hasbeen a change in a user of the virtual reality communication device.

If any of the steps of 702-704 are determined to be positive, acomponent of monitoring center 140 generates an alert to inform anadministrator or other personnel of monitoring center 140 at 705. Thealert can indicate that a prohibited action, prohibited verbalstatement, or a change in the authorized user has taken place in thevirtual reality session. At 707, monitoring center 140 determineswhether the positive determines of steps 702-704 triggers a terminationof the virtual reality session. Finally, at 706, monitoring center 140determines whether to continue monitoring the virtual reality session.If so, monitoring center 140 repeats steps 702-705.

Exemplary Computer Implementation

It will be apparent to persons skilled in the relevant art(s) thatvarious elements and features of the present disclosure, as describedherein, can be implemented in hardware using analog and/or digitalcircuits, in software, through the execution of computer instructions byone or more general purpose or special-purpose processors, or as acombination of hardware and software.

The following description of a general purpose computer system isprovided for the sake of completeness. Embodiments of the presentdisclosure can be implemented in hardware, or as a combination ofsoftware and hardware. Consequently, embodiments of the disclosure maybe implemented in the environment of a computer system or otherprocessing system. For example, the methods of FIGS. 5-7 can beimplemented in the environment of one or more computer systems or otherprocessing systems. An example of such a computer system 800 is shown inFIG. 8. One or more of the modules depicted in the previous figures canbe at least partially implemented on one or more distinct computersystems 800.

Computer system 800 includes one or more processors, such as processor804. Processor 804 can be a special purpose or a general purpose digitalsignal processor. Processor 804 is connected to a communicationinfrastructure 802 (for example, a bus or network). Various softwareimplementations are described in terms of this exemplary computersystem. After reading this description, it will become apparent to aperson skilled in the relevant art(s) how to implement the disclosureusing other computer systems and/or computer architectures.

Computer system 800 also includes a main memory 806, preferably randomaccess memory (RAM), and may also include a secondary memory 808.Secondary memory 808 may include, for example, a hard disk drive 810and/or a removable storage drive 812, representing a floppy disk drive,a magnetic tape drive, an optical disk drive, or the like. Removablestorage drive 812 reads from and/or writes to a removable storage unit816 in a well-known manner. Removable storage unit 816 represents afloppy disk, magnetic tape, optical disk, or the like, which is read byand written to by removable storage drive 812. As will be appreciated bypersons skilled in the relevant art(s), removable storage unit 816includes a computer usable storage medium having stored therein computersoftware and/or data.

In alternative implementations, secondary memory 808 may include othersimilar means for allowing computer programs or other instructions to beloaded into computer system 800. Such means may include, for example, aremovable storage unit 818 and an interface 814. Examples of such meansmay include a program cartridge and cartridge interface (such as thatfound in video game devices), a removable memory chip (such as an EPROM,or PROM) and associated socket, a thumb drive and USB port, and otherremovable storage units 818 and interfaces 814 which allow software anddata to be transferred from removable storage unit 818 to computersystem 800.

Computer system 800 may also include a communications interface 820.Communications interface 820 allows software and data to be transferredbetween computer system 800 and external devices. Examples ofcommunications interface 820 may include a modem, a network interface(such as an Ethernet card), a communications port, a PCMCIA slot andcard, etc. Software and data transferred via communications interface820 are in the form of signals which may be electronic, electromagnetic,optical, or other signals capable of being received by communicationsinterface 820. These signals are provided to communications interface820 via a communications path 822. Communications path 822 carriessignals and may be implemented using wire or cable, fiber optics, aphone line, a cellular phone link, an RF link and other communicationschannels.

As used herein, the terms “computer program medium” and “computerreadable medium” are used to generally refer to tangible storage mediasuch as removable storage units 816 and 818 or a hard disk installed inhard disk drive 810. These computer program products are means forproviding software to computer system 800.

Computer programs (also called computer control logic) are stored inmain memory 806 and/or secondary memory 808. Computer programs may alsobe received via communications interface 820. Such computer programs,when executed, enable the computer system 800 to implement the presentdisclosure as discussed herein. In particular, the computer programs,when executed, enable processor 804 to implement the processes of thepresent disclosure, such as any of the methods described herein.Accordingly, such computer programs represent controllers of thecomputer system 800. Where the disclosure is implemented using software,the software may be stored in a computer program product and loaded intocomputer system 800 using removable storage drive 812, interface 814, orcommunications interface 820.

In another embodiment, features of the disclosure are implementedprimarily in hardware using, for example, hardware components such asapplication-specific integrated circuits (ASICs) and gate arrays.Implementation of a hardware state machine so as to perform thefunctions described herein will also be apparent to persons skilled inthe relevant art(s).

CONCLUSION

It is to be appreciated that the Detailed Description section, and notthe Abstract section, is intended to be used to interpret the claims.The Abstract section may set forth one or more, but not all exemplaryembodiments, and thus, is not intended to limit the disclosure and theappended claims in any way.

The disclosure has been described above with the aid of functionalbuilding blocks illustrating the implementation of specified functionsand relationships thereof. The boundaries of these functional buildingblocks have been arbitrarily defined herein for the convenience of thedescription. Alternate boundaries may be defined so long as thespecified functions and relationships thereof are appropriatelyperformed.

It will be apparent to those skilled in the relevant art(s) that variouschanges in form and detail can be made therein without departing fromthe spirit and scope of the disclosure. Thus, the disclosure should notbe limited by any of the above-described exemplary embodiments, butshould be defined only in accordance with the following claims and theirequivalents.

1. (canceled)
 2. A method for monitoring a virtual reality session thatincludes a first device located within a controlled environment and asecond device located outside of the controlled environment, the methodcomprising: receiving, by a monitoring center of the controlledenvironment, information associated with a virtual reality session,wherein the virtual reality session is between the first device and thesecond device, and wherein the information includes video informationand audio information; monitoring, by the monitoring center, the videoinformation for a first alert condition that is based on detection of aprohibited visual action in the video information; monitoring, by themonitoring center, the audio information for a second alert conditionthat is based on a prohibited audio action in the audio information; andgenerating an alert based on at least one of the first alert conditionand the second alert condition.
 3. The method of claim 2, wherein thealert is configured to terminate the virtual reality session.
 4. Themethod of claim 2, wherein the video information comprises a pluralityof actions performed by an avatar associated with the first device inthe virtual reality session and the monitoring the video information forthe first alert condition further comprises: analyzing the videoinformation to detect an action in the plurality of actions; andidentifying the detected action as the prohibited visual action, whereinthe alert includes the detected action.
 5. The method of claim 2,wherein the audio information comprises a plurality of verbal statementsassociated with the first device in the virtual reality session and themonitoring the audio information for the second alert condition furthercomprises: analyzing the audio information to detect a verbal statementin the plurality of verbal statements; and identifying the detectedverbal statement as the prohibited audio action, wherein the alertincludes the detected verbal statement.
 6. The method of claim 2,wherein the information includes biometric information of a userassociated with the first device and wherein the biometric informationincludes at least one of a retinal sample, facial information, or avoice sample.
 7. The method of claim 6, further comprising: monitoring,by the monitoring center, the biometric information for a third alertcondition, wherein the third alert condition is based on detection of anunauthorized user in the virtual reality session.
 8. The method of claim7, wherein the biometric information further includes original biometricinformation retrieved during an initiation of the virtual realitysession and current biometric information retrieved after the initiationof the virtual reality session.
 9. The method of claim 8, whereinmonitoring the biometric information for the third alert conditionfurther comprises: comparing the original biometric information and thecurrent biometric information; determining, based on the comparing, adifference between the original biometric information and the currentbiometric information; and detecting the unauthorized user in thevirtual reality session based on the difference.
 10. The method of claim2, wherein the video information includes at least one of a plurality ofactions taken by an avatar in the virtual reality session and aplurality of interactions between avatars in the virtual realitysession.
 11. The method of claim 2, further comprising: recording theinformation associated with the virtual reality session, whereinmonitoring the video information and monitoring the audio information isperformed on the recorded information.
 12. The method of claim 2,further comprising: providing, by the monitoring center, authorizedcontent that is available to be used within the virtual reality session,wherein the authorized content is based on a user profile associatedwith the first device.
 13. A monitoring center within a controlledenvironment for monitoring a virtual reality session that includes adevice located within the controlled environment, the monitoring centercomprising: a memory; a processor configured to: receive informationassociated with a virtual reality session, wherein the virtual realitysession is between a first device located within the controlledenvironment and a second device located outside of the controlledenvironment, and wherein the information includes video information andaudio information; monitor the video information for a first alertcondition that is based on detection of a prohibited visual action inthe video information; monitor the audio information for a second alertcondition that is based on a prohibited audio action in the audioinformation; and generate an alert based on at least one of the firstalert condition and the second alert condition.
 14. The monitoringcenter of claim 13, wherein the alert is configured to terminate thevirtual reality session.
 15. The monitoring center of claim 13, thevideo information comprises a plurality of actions performed by anavatar associated with the first device in the virtual reality sessionand in monitoring the video information for the first alert condition,the processor is further configured to: analyze the video information todetect an action in the plurality of actions; and identify the detectedaction as the prohibited visual action, wherein the alert includes thedetected action.
 16. The monitoring center of claim 13, wherein theaudio information comprises a plurality of verbal statements associatedwith the first device in the virtual reality session and in monitoringthe audio information for the second alert condition, the processor isfurther configured to: analyze the audio information to detect a verbalstatement in the plurality of verbal statements; and identify thedetected verbal statement as the prohibited audio action, wherein thealert includes the detected verbal statement.
 17. The monitoring centerof claim 13, wherein the information includes biometric information of auser associated with the first device and wherein the biometricinformation includes at least one of a retinal sample, facialinformation, or a voice sample.
 18. The monitoring center of claim 17,the processor further configured to: monitor the biometric informationfor a third alert condition, wherein the third alert condition is basedon detection of an unauthorized user in the virtual reality session. 19.A non-transitory computer-readable medium having instructions storedtherein, which when executed by a processor in a monitoring center of acontrolled environment cause the processor to perform operations, theoperations comprising: receiving information associated with a virtualreality session, wherein the virtual reality session is between a firstdevice located within the controlled environment and a second devicelocated outside of the controlled environment, and wherein theinformation includes video information and audio information; monitoringthe video information for a first alert condition that based ondetection of a prohibited visual action in the video information;monitoring the audio information for a second alert condition that isbased on a prohibited audio action in the audio information; andgenerating an alert based on at least one of the first alert conditionand the second alert condition.
 20. The non-transitory computer-readablemedium of claim 19, wherein the alert is configured to terminate thevirtual reality session.
 21. The non-transitory computer-readable mediumof claim 19, wherein the information includes biometric information of auser associated with the first device and wherein the biometricinformation includes at least one of a retinal sample, facialinformation, or a voice sample.